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EDITING MULTIPLE LAYERS OF A PRESENTATION USING DETAIL-IN- 

CONTEXT LENSES 

The invention relates to tlie fidd of computer graidiics processing, and more spedfically to die 
editing of multiple layos of a presentation using detail-in-oontext loses. 

5 BACKGROUND OF THE INVENTION 

Display screens are the primary visual display interface to a compxiter. One problem widi diese 
visual display SCTeens is that diey are limited in size, thus presenting a challenge to usa- intoface 
design, particularly whm larger amounts of information is to be displayed This problem is 
normally refened to as the ""screen real estate pioblai'*. 

10 Well-known solutions to this problem include panning, zooming, soolling or combmations 
thereof While these solutions are suitable for a laige number of visual display applications, 
these solutions become less effective where the visual information is spatially related, such as 
maps, newspapers and sudi like. In this type of information display, panning, zooming and/or 
scrolling is not as effective as much of the context of the panned, zoomed or scrolled display is 

IS hidden. 

A recent sohition to this problem is the q^plication of *'detail-in-oonte3rtf presentation 
techniques. Detail-in-context is the magnification of a particular region of interest (the '"focal 
region** or "detail'O in a data presentation while preserving visibility of the surrounding 
information (tiie ''context"). Tbis tedmique has iqyplicability to the display of large surftoe area 
20 media, such as maps, on limited size conqniter soreens including Iqrtop computers, personal 
digital assistants ("PDAs"), and cell phones. 

In the detail-in-context discourse, differentiation is often made between the terms 
"Yqnesentation'* and "^presentation**. A representation is a formal syston, or m^[)pmg9 for 
spodf^g raw information or data that is stored in a conq^uter or data processing system* For 
25 example a digital map of a city is a rq>resentation of raw data mduding street names and tiie 
relative geogn^hic location of streets and utilities. Such a representation may be displayed 
visually on a computer screen or printed on pq>er. On the otiiorhand, a presentation is a spatial 
organization of a given represoitation that is apptoptista for the task at hand. Thus, a 

I 
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presentation of a rqnres^tation organizes such things as die point of view and the relative 
enq)hasis of differe n t parts or regions of tiie rqnesentation. For example, a digital map of a city 
may bo presented with a region magnified to reveal street names . 

In sGDsxel^ a detail-in-context presentation may be considoed as a distorted view (or distortion) 
S of a portion of the original rqnresentation wbexe the distortion is the result of the i^lication of a 
lens" like distortion function to flie original representation. A detailed review of various detail- 
in-ccmtext presentation techniques such as Elastic Presentation Space may be found in a 
publication by Marianne S. T. Caipmdale, entitled Framewoik for Elastic Presentation 
Space"' (Caipradale, Marianne S. T., A Framework for Elastic Presentation Space (Bumaby, 
10 British Columbia: Simon Fras» University, 1 999)), and inooiporated herein by refomce. 

bi g^eral, detail-in-context data presentations are characterized by magnification of areas of an 
ima^ where detail is desired, in combmation witfi oon^iression of a restricted range of areas of 
ttie remaining infimnation (i.e. the context), tiie result typically giving flie appearance of a lens 
having been applied to tiie display sur&ce. Using the techniques described by Caipmidale, points 
IS in a rqiresentation are displaced in three dunensions and a perspective projection is used to 
display the points on a two«dimensional presentation display. In detaii-in-context presentation 
systems, when a 1^ is q>pUed to a two-dimensional continuous surfiice representation, for 
example, the resulting presentation qypears to be three-dimensional. In ofbst words, the lens 
transformation appears to have stretched the continuous surface in a third dimension. 

20 One disadvantage of present methods and graphical user inter&ces for editing multi-layer 
presentations (e.g. layered datasets) is that they do not provide a user-fiiendly indication to users 
of the efifect that an editing operation performed on one layer has m other laym. Ibis is an 
exanq>le of the screen real estate problem r^erred to above. 

A need therefore exists for an in^ved method and gr^ihical user interface for editing layered 
2S datasets. Qmsequffltiy, it is an object ofthe present invention to obviate 
of the above mentioned disadvantages. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Embodinmts of tiie invention may best be understood by refisxing to flie folloiviog desorqrtion 
and accompanying drawings, in tilie description and drawings, line numerals refer to like 
structures or processes. In the drawings: 

5 FIG. 1 is a grq>liical representation of the geometry fixr constructing a tbree-dimensional (3D) 
pmpective viewing fiustum, rdative to an x, y, z coordinate system, in accordance with known 
elastic presCTtation space gir^diics tedmology; 

FIG. 2 is a graphical rqniesentation of the geometry of a i»:esentation in accordance with known 
elastic presentation space gn^hics technology; 

10 FIG. 3 is a blodc diagram iUustratiqg an ecemplaiy data processing system for inqilementing an 
embodiment of the invention; 

FIG. 4 a partial screm capture illustrating a GUI having control demmts fixr user interaction 
wifli multi-layered detail-in-context data presentations in accordance with an embodiment of the 
invention; 

IS FIG. S is a screen capture illustrating pixel level editing using a Pliable Display Tedmology lens 
in accordance widi an embodiment of the invention; 

FIG. 6 is a screen capture illustrating the viewing of two layers of data simultaneously in 
accordance with an embodiment of tiie invention; 

FIG. 7 is a soneen cq[>ture illustrating die editing of a lens layer in accordance with an 
20 embodiment of the invation; 

FIG. 8 is a screen cqiture illustrating how the marking of the lens layer also marks the base layer 
in accordance wifli an embodiment of the invention; 

FIG. 9 is a soeen ciqsture illustrating the switching of layers to reveal die modifications in the ^ 
former base layer in accordance with an embodiment of the invention; 
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FIO. 10 is a grafdiical rqmsmtation illustrating aahanced folding to view other layers of interest 
in accordance with an embodiment of the invention; 

FIG. 11 is a soea Cloture iUustrating how folding reveals the fi>cm of a 1^ 
image in accordance witt an embodimot of die invention; 

5 FIG. 12 is a screen capture illustrating a base layer fliroug)i a 1ms in accordance with an 
embodiment of the invention; and, 

FIG. 1 3 is a screen capture illustrating a '"windshield wiper^' e£fect to reveal an underlying layer 
in accordance with an embodiment of the invention. 

10 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In ihe following description, numerous specific d^ails are s^ forth to provide a diorough 
imderstanding of the invention. However, it is understood that the invention may be practiced 
without these specific details. In other instances, well-known software, circuits, structures and 
tedmiques have not been described or shown in d^ail in order not to obscure the invention* In 
IS the drawings, like numerals refer to like structures or processes. 

The tenn ''data processing system" is used herein to refer to any machine for processing data, 
including the computer systems and network arran ge mqits desoibed herein. The term ''Elastic 
Presentation Space" ("EPS") (or 'TUable Display Technology*' (TDrO) is used herein to refer 
to techniques that allow for the adjustmmt of a visual presmtation without interfering with tiie 

20 information content of the representation. The adjective "elastic" is included in the term as it 
implies the oq^ility of stretching and deformation and subsequent return to an original shape. 
EPS graphics technology is described by Carpendale in "A Framework for Elastic Presentation 
Space" (Carpendale, Marianne S. T., A Framework for Elastic Presentation Space (Bumaby, 
British Columbia: Simon Fraser University, 1999)), whidi is incorporated herein by reference. In 

25 EPS graphics tedmology, a two-dimmsional visual representation is placed onto a surfoce; this 
surfiice is placed in three-dimensional space; the sur&ce, containing the rq>resentation, is viewed 
through perspective projection; and the sur&ce is manipulated to effect the reorganization of 
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image details. The presentation transfonnation is sq>arated into two steps: sur&ce manipulation 
or distortion and perspective projection. 

FIG. 1 is a graphical rqxresentation 100 of fhe geometry for oonstniding a three-dimensional 
C*3D") perspective viewing frostum 220, rdative to an x, y, z coordinate system, in accordance 
S with known elastic presentation space (EPS) gnqphics tedmology. In EPS technology, detail-in-- 
context views of two-dimensional (**2D'') visual rqiresentatiims are created witii sig^t-line 
aligned distortions of a 2D information presentation surfoce within a 3D perspective viewing 
fiustum 220« In EPS, magnification of regions of interest and the accompanying compression of 
the contextual region to accommodate this diange in scale are produced by the movanent of 

10 regions of the sur&ce towards the viewpoint ("VP*^) 240 located at the apex of ttie pyramidal 
shape 220 containing the frustum. The process of projecting these transformed layouts via a 
perspective projection results in a new 2D layout which includes the zoomed and conqiressed 
regions. The use of the third dimension and perspective distortion to provide magnification in 
EPS provides a meaningful metiphor for the process of distorting the information presentation 

IS surftce. The 3D manipulation of the information presmtation sur&ce in sudi a system is an 
intmnediate step in die process of creating a new 2D layout of the informatioiL 

FIG. 2 is a graphical representation 200 of tiie geom^ of a presentation in accordance widi 
known EPS grq>hics technology. EPS gnq)hic5 technology employs viewer-aligned perspective 
projections to produce detail-in-context presentations in a reference view plane 201 which may 

20 be viewed on a display. Undistorted 2D data points are located in a basal plane 210 of a 3D 
perspective viewing volume or fiustum 220 whidi is defined by extreme rays 221 and 222 and 
the basal plane 210. The VP 240 is gmmlly located above the centre point of the basal plane 
210 and refermce view plane CRVP**) 201. Points in the basal plane 210 are displaced upward 
onto a distorted surface 230 which is defined by a general 3D distortion function (i.e. a detail-in- 

25 context distortion basis function). The direction of die viewer-aligned perspective projection 
corresponding to the distorted surfiice 230 is indicated by the line FPo - FP 231 drawn fiom a 
point FPo 232 in die basal plane 210 throu^ the point FP 233 which corresponds to the focus or 
focal region or focal point of the distorted surfooe 230. 
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EPS is aiq>licable to multidimensional data and is well suited to implementation on a computer 
for dynamic detail-in-context display on an electronic display sur&ce sudx as a monitor. In the 
case of two dimrasional data, EPS is typically diaracterized by magnification of areas of an 
image where d^l is desired 233, in combination witii compression of a restrict range of areas 
5 of the ronaining information (i.e. the context) 234, the end result typically giving the appearance 
of a lens 230 having bem applied to the di^lay sur&ce. Tbe areas of the lens 230 where 
compression occurs may be referred to as the ''shoulder" 234 of tiie lens 230. The area of the 
rq)res»tation transformed by the Ims may be refmed to as die "Imsed area". The lensed area 
tims includes the focal region and the shoulder. To reiterate, the source image or rq)resentation 

10 to be viewed is located in the basal plane 210. Magnification 233 and compression 234 aie 
adueved through devating dements of tiie source image rdative to the basal plane 210» and then 
projecting the resultant distorted surfoce onto die reference view plane 201. EPS performs detail- 
inrcontext presentation of n-dimensional data through tiie use of a i»Docedure wherdn the data is 
iDappGi into a region in an (n+1) dimensional space, manipulated tiirou^ perspective 

IS projections in the (n+1) dimensional space, and (hen finally transformed back into n-dimensional 
space fyr presentation. EPS has numerous advantages over conventional zoom, pan, and scroll 
tedmologies, inchiding tiie capability of preserving tibe visibility of information outside 234 the 
local region of interest 233. 

For example, and referring to FIGS. 1 and 2, in two dimensions, EPS can be inq>lemented 
20 ihrougih the projection of an image onto a referoioe plane 201 in the following manner. The 
source image or representation is located on a basal plane 210, and those r^ons of interest 233 
of tiie image for which magnification is desired are elevated so as to move tiiem doser to a 
reference plane situated between the reference viewpomt 240 and (he re£^ 
Magnification of tiie focal region 233 dosest to the RVP 201 varies inversdy with distance finom 
2S foe RVP 201. As shown in FIGS. 1 and 2, compression of r^cms 234 outside the focal region 
233 is a fimction of bofo distance firom foe RVP 201, and the gradient of the fimction desoibing 
foe verticd distance fma foe RVP 201 wifo respect to horizontal distance fiom foe focal region 
233. The resultant oombmation of magnification 233 and conqiression 234 of foe image as seen 
fixmi foe reference viewpoint 240 resdts in a lens-like efGxt similar to ^ 
30 applied to foe imi^. Hence, foe various fimctions used to vary foe magnification and 
conqjMression of foe source imi^ via verticd displacement fimn foe basd plane 210 are 
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described as lenses, lens types, or lens functions. Lms functions that describe basic lens types 
with point and circular focal regions, as well as certain more complex leases and advanced 
capabilities sudi as folding, have previously been described by Caipendale. 

System. FIG. 3 is a block diagram of an exenq>lary data processing system 300 for implemmting 
5 an embodiment of die invention. The data processing syston is suitable for implementing EPS 
tedmology and for viewiqg and editing detail-m-context presmtations in conjunction with a 
graphical user interfoce O'OUT). The data processing system 300 includes an input device 310, a 
central processing unit or CPU 320, memory 330, and a di^lay 340. The input device 310 may 
include a keyboard, mouse, trad[d>all, or similar device. The CPU 320 may include dedicated 

10 coprocessors and memory devices. The memory 330 may include RANf, ROM, databases, or 
disk devices. And, the display 340 may include a computer screoi or terminal device. The data 
processing system 300 has stored herein data representing sequences of instructions whidi when 
executed cause die m^od described herein to be performed. Of course, the data processing 
systm 300 may contain additional software and hardware a description of which is not 

IS necessary for understanding the invention. 

GUI yath Midti'Layer Editing Control Elements. GUIs for detail-in-context presentations are 
described in United States Patent Application Nos. 10/137,648 and 10/166,736, filed by the 
present q>plicant, and incorporated hoein by refermce. Gaerally, with a GUI, a user interacts 
with icons and controls in a GUI display by moving a pointing device, sudi as a mouse, whidi 

20 causes a cursor or pointa: to be moved on the display. When the pointer is over ttie displayed 
icon or control, the user presses a button, sudi as a mouse button, to invoke one or more 
operations to be performed by the coinputer system. In the following, a GUI having control 
demmts that can be implenented in software and applied to the editing of multi-layer detail-in- 
context data present a tions is described. The software can be loaded into and run by the data 

25 processing system 300 of FIG. 3. 

FIG. 4 is a partial screen capture illustrating a GUI 400 having control dements for user 
interaction with multi-layer detail-in-oontext data presentations in accordance wifo an 
embodiment of the invmtion. As mmtioned above, detail-in-context data presentations are 
characterized by magnification of areas of an iniage wfam detail is desired, in conihin^ 
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compression of a restricted range of areas of the remaining information (Le. the context), die end 
result typically giving the appearance of a lens having been emptied to the display screen surface. 
This stereoscopic lens 410 includes a focal region 420 having higji magnification, a surrounding 
shoulder region 430 where information is typically visibly compressed, and a base 412 
S sunx)unding flie shoulder region 430 and defining the extrat of the las 410. In FIG. 4, the l»s 
410 is shown with a circular shaped base 412 (or outline) and with a focal region 420 lying near 
the center of the lens 410. However, the 1^ 410 and focal region 420 may have any desired 
shape. Referring again to FIG. 2, in general, the stereoscopic lens 410 corresponds to projections 
of the distorted surfiice 230, fi>cal r^on 233, and shoulder region 234 onto the reference view 
10 plane 201. 

In general, die GUI 400 has control elements that, in combination, provide for the intoactive 
control of the las 410. Hie effective control of the diaracteristics of the lens 410 by a user (i.e. 
dynamic interaction with a detail-in-context lexis) is advantageous. At any given time, one or 
more of these control elonents may be made visible to the user on the display surface 340 by 

IS iq;>pearing as overlay icons on ttie lens 410. Interaction with each element is performed via the 
motion of a pointing device 310 (e.g. mouse), with the motion resulting in an appropriate diange 
in the corresponding lens characteristic. As will be desoibed, selection of wfaidi control element 
is actively controlled by the motion of the pointing device 310 at any ^ven time is determined 
by the proximity of the icon rqxresenting the pointing device 31 0 on the display surfiice 340 (e.g. 

20 cursor) to the appropriate component of the lens 410. For example, ''draggmgf* of flie pointing 
device at the perifdiay of Ae bounding rectangle of die lens base 412 causes a corresponding 
dbmgfi in tfie size of flie lens 410 (i.e. "resizing"). Tfaos, the GUI 400 provides die user with a 
visual rqnesentation of which control dement is bdng adjusted through the display of one or 
moie oorreqxinding icons. 

25 For ease of understanding, the following discussion will be in the context of using a two- 
dimensional pointing device 310 that is a mouse, but it will be understood that the invention may 
be practised with other 2-D or 3-D (or even greater numbocs of dimensions) pointing devices 
includmg a trackball and keyboard. 



8 



CA 02407383 2002-10-10 



A mouse 310 controls flie position of a cursor icon 401 ihst is displayed on the di^lay screen 
340. The cursor 401 is moved by moving the mouse 310 ova a flat surface, such as the top of a 
desk; in the desired direction of movement of flie cursor 401. Thus, the two-dimensional 
movemmt of the mouse 310 on the flat surfiice translates into a corresponding two-dimensional 
S movement of the cursor 401 on the display soem 340. 

A mouse 310 typically has one or more fin^ actuated control buttons (i.e. mouse buttons). 
While the mouse buttons can be used for diffiarent fimctions sudi as selecting a m«u option 
pointed at by the cursor 401, the disclosed invmtion may use a single mouse button to "select** a 
1^ 410 and to trace the movement of the cursor 401 along a desired path. Specifically, to select 

10 a lens 410, ttie cursor 401 is first located within &e extent of the lens 410. In odier words, the 
cursor 401 is ''pointed" at the lens 410. Next, the mouse button is depressed and released That 
is, the mouse button is '^clidced'*. Selection is thus a point and click operation. To trace the 
movement of the cursor 401, the cursor 401 is located at the desired starting location, die mouse 
button is dqyiessed to signal the computo* 320 to activate a 1ms control elemmt, and the mouse 

IS 310 is moved while maintaining the button depressed. After the desired path has been traced, the 
mouse button is released. This procedure is often refmed to as "clicking'* and "draggmg" (i.e. a 
click and drag operation). It will be understood fliat a predetermined key on a keyboard 310 
could also be used to activate a mouse didc or drag. In the following, the term **cliddng|" will 
refer to the depression of a mouse button indicating a selection by tfie user and tihe tmn 

20 **draggingf' will refer to tiie subsequent motion of ttie mouse 310 and cursor 401 without the 
rdeaseoftfae mouse button. 

The GUI 400 may indude the following lens control elements: move, pidoqp, resize base, resize 
focus, fold, magnify, and zoom. According to an embodimmt of the present inv^ition, the GUI 
400 may include the following additional control elemrats that are q^yplicable to multi-layer 

25 detail-in-context presentations: layer toggle, layer puU-in, layer selection, and clear occluding 
layer. Each of these control elements generally has at least one control icon or ahotiate cursor 
icon associated with it In gmeral, when a las 410 is selected by a us^ through a point and click 
operation, the following lens control icons may be displayed over the lens 410: pickup icon 450, 
base outline icon 412, base bounding rectangle icon 411, focal region bounding rectangle icon 

30 421, handle icons 481, 482» 491, magnify slide bar icon 440, and zoom iccm 495. In addition^ 
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layer toggle, layer pull*in, layer selection, and clear occluding layer icons (not shown) may be 
displayed over the 1ms 410 or on a toolbar or pull-down menu. Typically, , these icons are 
displayed simultaneously after selection of the 1^ 410. In addition, when the cursor 401 is 
located within the extent of a selected lens 410, an alternate cursor icon (e.g. 460, 470, 480, 490, 
S 496) may be displayed over the lens 410 to replace the cursor 401 or may be displayed in 
combination with the cursor 401. In addition, when layer toggle, layer pull-in, layer selection, 
and clear occluding layer functionality is selected by the user, for example, throu^ a toolbar or 
puU-down menu, corresponding altmiate cursor icons (note shown) may be displayed to replaoe 
ttie cuiBor 401 may be displayed in combination widi the cursor 401. IbenK>ve, pidoqi, resize 
10 base, resize focus, fold, magmfy, and zomn lens control elements are described in United States 
Patent Application Nos. 10/137,648 and 10/166,736 mentioned above. Tlie layer toggle, layer 
puU-in, layer selection, and dear occluding layer control dements are described bdow. 

In general, yifbm a lens 410 is selected by a point and elide operation, bounding rectangle icons 

15 411, 421 are displayed surrounding the base 412 and food region 420 of the selected lens 410 to 
indicate that flie lens 410 has been sdected. With respect to the bounding rectan^es 411, 421 
one mig^t view fhem as ^ass windows endosing tfie lens base 412 and focd region 420, 
respectivdy. The bounding rectangles 411, 421 include handle icons 481, 482, 491 allowing for 
direct manq>ulation of the endosed base 412 and focd region 420. Thus, the bounding rectangles 

20 411, 421 not only inform tiie user fliat die lens 410 has been sdected, but also provide the user 
wifli indications as to what manipulation operations mig^t be possible for fte selected lens 410 
though use of the di^layed handles 481, 482, 491. Note tibat it is well within the scope of the 
present invention to provide a bounding region having a shape other than gaierally rectangular. 
Such a bounding region could be of any of a great number of shapes induding oblong, ovd, 

25 ovoid, conical, cubic, c)dindricd, polyhedrd, sphericd, Moreova:, the cursor 401 provides a 
visud cue indicating ibe nature of an available control elonent As sudi, the cursor 401 will 
gmerdly change in form by simply pointing to or selecting a different control icon (e.g. 450, 
412, 411, 421, 481, 482, 491, 440, 495). For example, when resizing the base 412 of a lens 410 
using a comer handle 491, the cursor 401 will diang^ form to a resize icon 490 once it is pointed 

30 at (i.e, positioned over) the comer handle 491. The cursor 401 will ranain in the form of Ae 
resize icon 490 until Ae cursor 401 has been moved away from the comer handle 491 . 
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In addition, Ae GUI 400 maintains a teooid of control elonent opoations sudi that the user may 
restore t»re-opeFation pres^tations. This record of operations may be accessed by or presented to 
the user throu^ "Undo" and "Redo" icons 497, 498 or a pull-down operation history menu (not 
5 shown). 

Editing Using Detail-Jn^Contexi Technology. Existing detail-in-context technology can be used 
to advantage in data editing. Using a detail-m-oontext technology sudi as PDT, the user can 
enlarge an area of interest to more clearly view the area to be marked, and fhm modify ttie 
image. Hie user fbm has the option of saving flie modified image> or cancelling tiie operalioit 

10 Consido* the editing process when Ifaeimag^ in the lens contain 

die base. Using detail-in-context technology with layered datasets or scale<lependat rendering 
sigDificantly enhances the editing process. Hie present invention provides inqnoved editing 
usmg detail in-context tedmology (e.g. PDT). 

Single Layer Editing wiA PDT Lenses. One of the most common, yrt troublesome, tasks is to 
15 precisely mark areas of interest Using detail-in-context technology such as PDT, the area of 
interest can be magnified to pixel level resohition and then modified with pixd accuracy. An 
example of this {ffooess is shown in FIG. S. In this example the user is dealing witii only one 
image. Hence, die modifications affect only one image. 

Scale D^endent Rendering and Layered Datasets, There are a number of applications where 
20 users deal with layered data. Map servers, for example, create maps based on requested layers, 
location, and resolution* Hiese types of i^lications are conducive to scale dqiendent rendering. 
That is, the base image (die data or image outside the lens) displays an image at low resolution 
while the image in the lens (a different image altogether) is displayed at a resolution based on ttie 
lens magnification. 

25 Layered datas^ do not necessarily have to be associated with scale depeodcat raidering. As 
anotho: example, consider a number of images that line up spatially. They could be aerial photos 
of a particular location taken at various times of the day. Or consider a number of photos related 
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to the design of a building: a profile fixnn the outside, a structural diagram, and an electrical 
diagram. 

Photoshop, CAD, and such packages also provide layering ci^abilities to ivfaich tiie present 
invention coukl be i^yplied* Data such as medical imagnig data or ^ectral data that is being 
5 layoed to identify changes m data ova: time can still be ovoiaid for editing purposes; the layers 
do not necessarily have to be exactly the same for the pres«t invention to be applicable. 

FIO. 6 Ulusbates the aMioept of layering datasets with a lens. The two images in FIG. 6 are lined 
iq> spatially. The base image is a street nuQ> of South Seattle vAUe flie layer viewed within the 
lens is an aerial photo of exactly the same place. 

10 Editing Through Multiple Layers. According to an CTibodiment of tibe preset invmtion, the user 
is able to marlc Ae data in die l«s in one or more visible layers, and have results penetrate 
through to otiier layers. For exanQ>le, consider the case of hig^ghting the wharf shown in the 
centre of Ihe lens of FIG. 6. FIG. 7 shows the lens layo* having ben modified by adding an **X'* 
mark overtiie wharf. 

IS Referring to FIG. 8, after moving the lens away fiom Ae whar^ notice that the street mi^ also 
has an **X" over it in exactly the same location. Note that the position of tiie is indicated witfi 
an arrow in FIG. 8. 

Editing through a las may also modify otiier layers of data. Eadi of fliese layers may be saved 
individually fixr later access. 

20 The present invention indudes the foUowing embodiments: 

1. Modifying the lens layers also modifies the base layer. 

2. Modifying the base may modify flie lens layer. 

3. All rdated layers may be modified. 

4. Only specified layers may be modified. 
25 5. Layers may be edited wifliout a lens. 
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6. Edited areas may be bookmaiked 

7. Lens may follow an edited patfi(e.g. a road) 

8. A toggle button may be defined to switdi layers. The base may then become the lens 
layer while the lens layers becomes flie base. This would ease the process of diecking to 

5 see if die edit made to one layer penetrated to the next layer. If more than two layers 

where being viewed, then each layer could move forward into the Ins in sequence. FIG. 
9 shows an example of switching the layers, making it much easier to see that the * X* has 
indeed modified another layer. 

9. A slider associated witfi MDLC (i.e. '^Modular Design Lens Contror) controls may be 
10 used be puU in layers. See United States Patmt Application No. 10/137,648 refmed to 

above. 

1 0. Modified layers may be saved for later access. 

11. Editing may imply any type of modification to die imag^ including cropping. For 
example^ csopping one layer may crop Ae ofba layor too. It may imply pasting an icon, 

15 text, or feature. These niay also penetrate to the next levd. In fiict, it could be any of flie 

host application's toolbar fonctionality. 

12. Three layers may be viewed at the same time. The base may be one layer, tiie shoulder 
anotiier, and the focus yet anotiier. 

13. The lens may have as many shoulders as there are layers. For exanq>le, a five layer 
20 datas^ may have a five step pyramid. 

14. Multiple lenses may be used. Eadi lois may show a dififeroit layer of a particular area. 
For example, the base map may show the street map of Seattie. Lens "A" may show a 
daytime aerial while lens "B" may show a ni^itdme image. Blending may show an 
afternoon image. Any of die lenses may be used for editing. 

25 IS. The data may represent raster data, vector data, or point data. 
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16. Two difierait windows may be viewed concurrently. For example* one window may 
show raster data of a layer while the second window may show vector data. Eadi window 
may have its own lens. Editing data through the lens of one window will also modify data 
in tfie oflier window. 

5 17.TheIdatedlayersmaybeattadledasUttleiconstoand^4D^ 

1 8. PDT and EPS tedmology indodes a concept, wUdi may be lefiBned to as **foldingf in 
ixliiGh, for exanqde, an in-context detail view of information can be displaced so as to 
move the region of interest wifliin the plane of the display, while retaining a continuous 
connection widi some of die contextual infimnation. Referring to FIG. 10, folding may 
10 also be used to view the d^ail of an underiying layer. As folding is 4>plied, it is as if a 

lens is Idt behind revealing the base layer while the detaO in the folded area reveals the 
information that was previously in the lens. In this way one layer can be "^peeled" away 
so foat two layers can be viewed at the same time. In FIG. 1 1 , folding is applied to the 
las to reveal the lens focus of the layer below. 

IS Another way to view the base layer Arough the lens is via an opmtion or tool or fonction that 
opens vp foe ooduding layer. lii one embodiment of the present invention, sudi a tool or 
operation would allow foe user to defiie a rectangle or ofoer shape over foe area foey want to 
make transparent or clear away. The tool could be interactive in that as foe rectangle gets bigger, 
more of foe ooduding layer is deared. A simple line^wing-like tool could be qqplied to have a 

20 similar effect The line acts analogously to a windshidd wipo:, clearing foe occluding layer. This 
embodiment is ilhistrated in FIGS . 1 2 and 1 3 . The invention can also be applied to layers that are 
rendered in foe lens based on foe magpification of the lens (Le. scale d^odent rendering). 

Data Carrier Product. The sequences of instructions i^di ^en executed cause foe method 
described herein to be p^ormed by foe exemplary data processing system of FIG. 3 can be 
25 contained in a data carrier product according to one embodiment of the invmtion. This data 
carrier product can be loaded into and run by foe exemplary data processing system of FIG. 3 . 

Computer Software Product. The sequmces of instructions whidi when executed cause foe 
mefood desoribed herein to be performed by foe exemplary data processing system of FIG. 3 can 
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be contained in a computer software product according to one embodiment of die invention* This 
computer software product can be loaded into and run by the exemplaiy data processing system 
of FIG. 3. 

Jn^rated Circuit Product The sequences of instractions which ^Brtien executed cause ttie 
method described herdn to be pofimned by the exmplary data processmg system of FIG. 3 can 
be contained in an integrated circuit product including a coprocessor or memory according to one 
embodimmt of the invmtioa This integrated circuit product can be installed in the exonplary 
data processing system of FIG. 3. 
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